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Description 

s The present inventmn relates to a method oi oodaig and decoding an Image by applying gioixit moifon compenea- 
tlon to Ihe whole image based on linear Interpolation and/or exIrsQaoiation or t>frtnear intensolaljoii and/or eietrepolation. 

w In the highly efficierti coding of a dynemto bnage. it hae been known, in repogniHon of the elmllarfty of the frames 
that are cloae to each other In regard lo time, to use motion compen$atiaii in oompreasing the data. The most wktety 
used motion compensation system at present image oocfing technology ie blook matching* employed in Standards 
H.261. MPSG1 and vvhic^ are International standards for a dynamic Image coding eystem. Aocordfaig to thie 

system, the Image to be coded is cifvided Into a number of blocks, and a motion vector is lomd for each of the biocte 

IS Rg. 1 (Ikjatrates the conetHution of a coder 100 of the H.261 dtandaid which emptoys a hybrid codbig system 
(adaptive interframe/intrafiame coding method) which is a oonibination of blocK matching and OCT (discrete cosine 
iransform). A subtractor 102 calculatee the cfilfaranoe between an input image (original image of preeent frame) ioi 
and an output image 1 13 {thai wiH t>e d^critMd later) of an interframe/intrafranie switching unit lid, and otitis ait 
error Image 109. The errar image Is transformed into a DCT coelf icient through a OCT processor 104 and is quantized 

20 through a quantizer 105 Id obtain a quantized OCT coeff kaent 106. The quantized DCT coefficient is output as tranefer 
data onto a communication line and is. at the same tlme« used in the coder to eynmesize an interf rerne predicted image. 
A procedure tor ^nihesizing the predicted image will be described below. The quantized DCT coefficient 106 passes 
ihrou^ a dequarrtizer 108 and an inveree OCT processor 109 to fomrt a reconstructed error image 110 (the same 
image as ttie enor image r^iroduced on the recdving side). 

J35 An output frnage 1 1 3 (that wtH be described later) of ttie intertFame/intraframe switching ur« 1 19 is added thereto 
^ouc^anadderil 1. thereby to obtain a reconstructed image 112 of thepre&emffema (the same image as the recorv 
structed Image of the present frame reproduced on the receivHig oidd). The Image id temporarily stored in a frame mem- 
ory 1 14 and Is delayed in time by one frame. At the present moment, tfterefore. the frame memory 1 14 is outputting a 
reconstructed image 1 16 of the preceding frame. The reconstructed image of the preceding frame and the input image 

30 101 of the ixeeent frame ar« input to a lalock matching uiH 116 where block 

In the Mock matcliing, an image te divided into a plural of btocks. and a portion most resembling the criginEU 
image of the present ftame 2s taken out (or each of the btocks frem the reconstructed image of the preceding irame, 
ther^ synthesizing a pr^icted image 11 7 of the preeem frame. At this moment, it Is neceesary to execute a procesa- 
ing (kx»l motion estimafibn) Ibr detecting how mu^ the bkxks have moved from the preceding frame to the present 

^ frame. The motion vectors of the blocks detected by the moUon estimatian are transmitted to the receiving ade as 
motton data 120, from the motwn data and th© reconstructed image of the preceding franw, the rec^ving side can sytv 
thesize an estimated image which is the same as the one that is obtained tndependentty on the transmit^ng side- 
Referring again to Fig. 1, the estimated Image 1 17 is input together with a "0" signal iid to the interframa/intra* 
frame switching unit 119. Upon selecting either of the two InputSp the swvHdiing unit switches the coding either the Inter- 

40 frame coding or ^ intraframe cocfing. When the precticted image ii7 is selected (Ftg. 2 iiiustratee this case), the 
imerframe coding is eixecuted. When the 'O** ^nal is seldcted. on the ottter hancd the input image is directly DCT-coded 
and is ouqxit to tite communicatic^ Ibe^ Therefore, trie intraframe coding Is executed. 

in order to properly obtain the reconstructed image on the receiving dde, it becomafi necessary to know whether 
the interf rame coding is executed or the Intraframe coding is executed on the transmitting skie. For this purpose, a dts^ 

49 tinctkm flag 1^1 output to the communk:ation itne, Thefmat }-l.2d1 coded bit stream 123 is obtained by multipleiring 
the quEtmized DCT coefficient motion vector, and Interlrama^ntraframe disti»ictk>n flag into multiplexed data In a muiti* 
plexer 122, 

Fig. 2 illustrates the Consjlitution of a decoder 200 for receiving a coded t^t sti eam output from the coder ot Fig. 1. 
The H.261 bit stream 217 that is received is separated throuc^ a separator 216 into a quantized DCT coeffident 201. 
so a molbn vector 202. and an intraframe^nterframe distinction f iag 203. The quantized DCT coefficient 201 is decoded 
Into an error image 206 through a dequantfzer 204 and an inverse OCT processor 205. To the error image is added an 
output image 21 S of an Imerframe/imraframe ewdtching unit 214 through an adder 207 to form a reconstmcted image 
208. 

The interframe/intrsirame suvftching ur^ svmtches the ou^ according to the interfmme^tratrame coding distinc- 
65 tton flag 203. A predk:ted image 21 2 that b used for execu^ng the Hiterframe coding is eymheeized by a predcted imag e 
syntfieslzer 211. Here, the decoded Image 210 of the preceding frame stored in the frame memory 209 i^ S(i>iected to 
a processing of moving the portion of each of the blocks according to the motion vector 202 that is received, in the case 
of intralrame ceding, on the other hand, the tmeiframe/Intrdframe ewltcNng ithii outputs the X"* signal 213. 

Stock matching is a motion oompensafa'on system that is new nnost wkieiy utilized. When the whole image Is 
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expanding, contracting, or turning, however. th« motion vec^ of att of tha blocks must t>8 tmnsnruttixi. causing a prob* 
lam cyf low coding off idanpy. To aotva thia probtam, Q\db&\ motion con^nsation (e.g., M. Hotter, "DKfarent^al Estimation 
of the Oidsal Motion Parameters Zoom and PavT, 8igha) Proc^^ng. Vbl, 16. No. 3. pp. 249-265, Mar., 1989) haa been 
proposed to axprasa the motion vector f\M of the whole Image while not i^ing many parametarSw AOCQitiing to this 
s motion compenaation system, the mcftion vector {us{x. Y)^ vg(x, y)) of a pixel (x, y) in an image Is expreaeed in the form 

Ug(K y) - ao>« + a iV + fla Equation 1 

i<f Vg(x,y)-a3X+a4y-a5 
or 

Uo(?5.y)-bo)<y ■frb^x-baV + ba gC|«rtion2 
v^(x,y)«b4xy + b5X + bBy + b7 



IS 



and the motion compansaAion la executed using the motion vectora. ^ theae equafeiona. ao to aS and bO to b7 are 

motion parBmetera in executing the motion conpenaatioa fbe aame predicted Iniaga muat be generated both on the 
eo imnsmitting side and on me receivlr^ eide^ For this purpose, tfie tranamifiing side may cBrectiy tranamil vaTuea of aD to 

aS or bO to b7 to the receiving 6ide or my inatead tranamlt mpiiDn vec^ of aevarai reprasentatlva points. 

M ehown in fig. 3A« aasume that the coofdinates of the pixels at ttie left upper, right upper, left lower aixl nght 

loyvar cornera of an image 901 ive expressed by (0* 0). (r 0). (0. s) and (r. s) (where r and s are positive integers). Here. 

■letting the horizontal and vertical oomponenis of Xh» moiSon veetoie of the i:epresei^tive points (0, 0), (r, 0) and (0, a) 
25 be (ua, va)« {Utot vb) and (uc, vc), raspecttvely; Squation 1 id rewritten as: 

* • ' ^ ■•*■••*.!•■ ' 

Wg{x.y)"~iSx+^i^y+Ujj Equation 3 



so 



90 



a 

* 



This means tf^ the same function can tw fUtf Bled even when ua, va, ub, vU uc and vc are trensmtttod iiiGleacI of 
35 transmitttng ao to aS. This state is shown in Figs. 3A and.QB. The mtnion vectore $06» 307 and 308 (the motion vectors 
ffi-e defined to start from points of the orig^ai image of the present frame and ends at the corresponding points in me 
reference image) of the representative points 3b3» 804 and 305 may l>e transmiited instead of the motion parameters 
. based on the assunpiion that giobat motion compansalion between the original lirngfr 302 of the present frame shown 
in F^|. SB and the reference Imago 301 shown in fOg. 3A is exacted. Similarly, by using the horizontal and vertical com- 
40 ponents (ua. va). (ub. vb). (ud vc) and (ud. vd) of tour r^esentativa points (0, 0)» (r. O), (0, s) and (r, s). Equation 2 can 
be rewritten as: 

■ 

« ■■ ■ ■■,„?M.„ S — Sxy+ ■ ■ . ? --.y x-i- y+u^ 
rs r 8 ■ 



Therefore, a einvlar function is fulfilled even when ua, va, ub, vb, uc. vc. ud and vd are transmitted Instead of t>0 to 
b7. In this specification, the system using Equation 1 is referred to as global motion compensation based upon linear 
interpolation and/or extrapolation, and the system using Equation 2 is referred to as global motion con^pensatlon based 
Bs upof^ 9)0 bilinear interpolation and/or extrapolation. 

Fig. 4 ffiustFBtes the oonatHiition of a motion compensation section 401 of an image coder employing the global 
mo^on compensation eyatem based upon finear imeipoiation and/or extr^tpotation tor transmittng motion vectors of 0ie 
representative polnte. The si»iie components as those of 1 are denoted by the same r^ence numerals. A video 
coder VtvA exacutas 0Ok>Bl motion compensation can t>e constituted by substituting a motion compensation section 40i 
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tor th6 i^ck matching unit 1 16 of R9. 1. 

A gtobad motion cort^pensation unit 402 performs motion estimstion related to the global motic^ compenfiatim 
betwednthedoGcxtdd image ti6 of the preceding franneand thaonginat image 101 of thepreG^frama. and eetimatea 
tha v^uas ua, va, ub, vb, uc and vc. Tha data 403 related to these values are tran«ntitted aa part of the motion data 

0 1 20< A predicted image 404 of global motk>!> compensation is synthesized using g^iuation 3, and i$ fad to a block match- 
ing ur^ 405. Tha motion is compensated by block matcNng bittween the predlctad image of glob^ motion compensa- 
tion and die original Image of the present frame, ther^ generating motion vector data 406 of blocks and a f InaJ 
predicted image 1 1 7, The motion vector data and the moBon parameter data are multiplexed through a muHiplaxIng unit 
407 and are output as mo£qn data 120. 

10 fig, 5 illuatrates the constitution of a motion compensation section €0 1 which is different from that of Hg. 4. A video 
coder that executes global motion compensation can be constituted by subs^Ung a motion compensation section $01 
for the block malching unit 11$ of Fig. 1 . In this embodiment, block matching is not ackqTted for tiie predicted image of 
gtobaf molbn condensation but either global motion compensation ot block matching is adopted fbr each of the blocks. 
Oobal motion compensation artd bfock matct^ng are executed In paraiiei by the gtobai motion compensation orHt 502 

IS and the bk>ck matching unit SOS between ^e decoded image l15of the preceding frame and the original image 101 of 
the present frame. A selection swttch 508 selects an optimum system for each of the blocks bet\^een tite predicted 
Image 503 of c^obal mc^ion condensation and the predicted image 506 aS block matching. The motion vectors 504 of 
the representative points, motion vectors 507 of the blocks and seleotk^n data 509 of gioba! motion conpensatKHiAjJock 
matching are mult^iexed by the multiplexk^g unit 510 and are output as motion data 120. 

20 By drrtroducing the abova^mentiorted glotMl motion compensation, it t^ecomes possiUe to e^^ess the general 
mqti^ of the jn^ge uaing fevv param^ers and to aocompDsh a high data compression ratio. However. ^ amounts of 
coding processing and decoding processing become larger than those of the conventional systenfis. In particular, the 
division in Equations 3 and 4 is a meyor factor of complewty in thdpi'ocaftaing. 

• • • • 

The globat motion compensation in which the nrotion vector field of the wfide image is appnsximated by a few 
parameter^, invotvas a pmbtem d increasing the amount of processing involved in synthesizing a predicted image. The 
object of tiie present invention is to decrease the amount of the processing by substituting a trinary number shift opeir* 
M ation for the division in the global motion corrpensation. 

: . Tha divisf^ Is realized t?y the shift operation py aultabiy selecting the coordinates of representative points at .the 
tirne of executing the global motion compensation. 

38 

Fig. 1 is a diagram iiluatrating tiie constitution of an H.261 video coder. 
Fig. 2 is a diagram lUustratirH) the constitution of an H.261 video decoder. 

Tigs, 3A and 3B are diagrams illustrating on example of global motion compervBOtion for transmitting the motion 
vectors of representative points^ 
40 Rg. 4 is a diagram itiustrating a motion compensation section of the video decoder fbr effecting the Idlock matching 
of a predicted image of global motion compensation. 

Fig. 5 is a diagram illustrating a motion condensation section ot the vkieo coder for selecting eitiier the global 
motion condensation or the block matching for each of tiie bksdos. 

Fig. 6 is a diagram iUustrating the arrangement of repreeerrtattve points for e>cocu1^ high-speed processing. 
4S Fig. 7 is a diagram illustrating a region for finding the motion veotore by extrapolation lA^tNn the image. 

Fig. 3 is a diagram itiustrating an example which tiie motion vectors of all pueta in the image are found by interpo- 
fation from tiie motksn vectors of the representative points. 

Fig. 0 is a diagram in which the imago is divided into two right triangles, and the global motion compensation is exe- 
cuted for each of them based on intefp<^tion from tine motion vectors or the representative points. 
50 Fig. 1 0 i^owB a flow Chart for performing video cocfing according to an embodiment of the Invention. 

Fig. 1 1 ^ows a flow chart f^ performing video cocfing according to another embodiment of the invention. 
Tig. 1 2 ^ows a flow chart for video decoding according to an embodiment of the invention. 
Fig. 1 3 shows a flow chart for video decoding according to another enrtbodiment of the invention. 
Fig. 14 Is ft diagram of a software encoder for a video coding method according to an embodiment of the invention. 
ss Flg> 1 5 i$ a diacram of a software decoder for a video decoding method according to the present invention. 
Fig, 1 8 is an overall diagram of a video encoder of tiie present fawentic^. 

Fig, 17 Is a diagram of a motion connpensation unit used in ttie encoder or Pig. 16. according to one entxxiimertf 
of tiie Invention. 

Fig. 18 is a diagram of a motkm condensation unit used in the encoder of the invention shown in Fig. 1 6 accotxiing 
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tQ another embodimdnt of the invention. 

FiQ. 19 is a diagram ol a video decoder for decoding a vkteo signal according to the present invention. 

Fig. 20 is a cfiagram of a precHcted image eyntheeizer used in the video decoder of Fig. 1 9 adcoiding to one embed" 
Iment ol the Inventkin* 

s Fig. 21 is a (togram of a predicted image syntf^eatzer used In the video decoder of Fig. 19 acoordfang to another 
endwcftment of the preeerit invention. 

Pftlftfiyi peytriptitm of ihe Preferred En^odimenta 

In the foHovtring description, tfie sampling imervale for the pixeie ere 1 1n botfi the horizontal and vertical directions, 
afKl the coordlnatee of tne pbeele at the left uppar, rigw q5per, left lower and right tower corners are expressed bf (0. 0). 
(r, 01 (0, a) end (r, &) Cwhere r and s are positive integers), re&pedively. as shewn in Fig. 3A. 

if the motion vector fe quantized ibr each of the pbrels in compensating the motion based L^?on the linear interpola- 
tion and/or extrapolaiion (affine tmnsform) or the bilinear interpoiafon andft>r extrtipolafion ^iitnear transform). miS' 
matching can be prevented and the opemtion can be ^mplifjed (Japanese Patent Application No. 1d3d70/1 994), in the 
following desertion, it is aesurned that the horizontal component and vertical component of a moti(>n vector of a pixel 
are Integral multiples of 1/in (where m te a po^e integer). Further. It is assumed that the glotsaj motion compensation 
is executed using the rTiotion vectors of repiieeentative potnts expfaifTed in the 'Prior Art* and that the motion vectors Of 
the fspresentativB pointa are integral multiple d ^M {where k is a positive imeger), fn this fipecKlcation, the "motion v^- 
tors of ptxela* are the motion vectors that are actudly used tbr synthesizing a predicted Image. On the onrter hand» the 
"motion vet^ora of representative pdnts" are the parameters used for calculating the motion vectore of pixelSL Baoause 
Of the (fitf^ence in the quantization step sizea, theralpre, the motion vectors of pixels oft«i may not be in agreement 
with the motion vectors of repreeentattve polnte even though they have the same oooidinates. 

Wim reference to Fig. 6, a caae based upon linear tntenxklation- end/or.Mrapolation.wlll be e^tplained. Here; aa 
descried In the "Prior Art*, the representative points are net those ioqated at the conr>erB of ihe Image 60 1 . but are the 
points 602p €03 and 604 havfrig the ooordinalea (i. j). (i^i; j) and (i. 0. 1 p and q are Negers). respective At this 
moment, the points 602. 603 and 604 inside or outside the image. Letting the coordinates whose values are 

gh/^ by muii^ng the horizontal and.verticat components of the motion vectors of the rspre^tativa ppin^ by )c be 
respectively (uO. vO). (ul, vl) and (u2. v2> (uO/vO. u1, v1. u2 and v2 are int^ers). cobrdinatiss (u(x y) and v(x, y) 
(where x, y. u(x. y) and v(x» y) are integers) which are m times ^ honzontal and vertical components of the motion vec- 
tor ot a pixel « y) are expressed by the foltowing equttf ons: 

t^x. y) « ((u1 -uO){x-4)q4<u2-uO)(yHh>4iiQpq)m//(pqk) Equation 5 

OS v(x. y) m {(vl *w0)(x-^)q+(v2-v0)(y-i)p4v0pq)m//(pqk) 

where^/r represents divisjon tor lOunding ihe quotiem of ordHwy division into an adjacent integ^ when the quotient is 
not an integer, and its priority as an operator is the same as that d multistation and division. To deaease the operation 
enor, it is desirable that a vatue which is not an mteg er is munded to the most adjacent integer, in this case, the methods 
40 for roundlbg a v^e of tfie sum of an imager and 1/2 are: 

(1) Rouncting the v^tue toward 0; 

(2) Ffount^ng the value away from 0; 

(3) Rounding tne vatue toward o when the dividend is negative, and rounding the value away from 0 when tne <fiv^ 
idend is poeltlve (assuming that the divisor is positive at all ^mes) ; and 

(4) Rounding the value away from 0 when the dividend is negative, and rounding the value toward 0 when the div- 
idend is positive (assuming that the divisor is posi^ at ail times). 

Among them. (3) and (4) are advantageous from the sfcanc^nt of processing quantity since the rounding direc^on 
so does rtct change irrMpeetive of whether dividend is po»th/d or negative and there ts no need to judge whether the 
eign is positive or negative. High-speed procesaing accoiding fo method (3) can be realized by the following equation: 

u(x. y) - (lp«^(u1 -uO)(x^)q +(u2sj0)(yi')p+u0pq)iTH(pqk#2))#(pql<)-L Equation 6 

85 v(x, y) (Mpqk4-((v1 ^vO)(x-0q +(v2^vO)(yi^vOFX|)ni-Kpq^))4HlxM-M 

where *'r represents division of an integer for rounding off the decimal part toward 0. which is. usuaOy. most easily reai* 
ixed using a cdmputer. L and M are sufficiently large positive integers for m^ntaining the dividend of division to be pOS' 
Itlve at Gdl times. The term (pqk « 2) is used tor rounding the quotient of division to ihe rr>ost acyacent integer. 
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Inteaer proceGSing contributes to decreasing the amoifiit of processing. Here, assuming that p« q and k are 2^ 
and 2*^. rafipecfiveiy wherein a and ^ are positive Integers, and hO Is an Naodr wWch is not negative. The division of 
E(|uaton 5 can l^e reelUed by the shift operation off o^-^^-hO bitB, mating it poseii^le to greatly decrease the amount of 
pracefiGinoiaing a ooinputer or dedicated haidware.Furttieitnora*assunrtifiglhatifnis2^^ (hi ie an integer which is not 
negative, aid hi < a+p^ho ), Equation 6 can t>e rewritten as: 



y) - ((2L+l><-r(a+p+h04i1-1)+<ul-uO)(x-i) «p 
-Ku2-uO)(y-j)«a+uO«(cc+P»»(a+P't+>0*h1)-L 

Wx, y) * ((£M*1)«(«*^i+hO-hl'1>f(vl"vO)(x-i) «}i 
•i'(v2-vO)(y^«a-»'VO «< ew-p)) »(oc+p+hO-h1 )-M 



legation 7 



30 



40 



4$ 



90 



where « o" means that x is shifted lent>y atstts and 0 is suDst^uted for the low-oider ataits. *x » o** means that x 
IB is shifted by a. and 0 or 1 is substiluted for the high^order a bits (when x Is a numlaer of oomptement represen- 
tation or 2, f is substratted when the nwst dgnif^cant bit Of x is i and 0 is substituted when tt is 0). and the priority of 
these operatons Hes between addition/subtraction and ntuitlplicationftllvlsion. maNng it poasibie to fcirther stmptify the 
operation. 

When the ttnaar interpolation and/or axfrepolation is used, letting (u3, v3} be the coordinates datermined by miiti- 
20 plying the horkontat.and vertical oomponenrts of a motion vector Of a representative point at (i^, h<d^K E<|uailon 5 
is rewritten as £c|uatlon 8 or Equation 9. as follows: 



u(x. y) « ((u1-uO)(x-QQ^u3-ul)(y'*J)PHi0|x0m//(pqk3 
v(x, y) " ((vi*vO)(x4)q+(V3-v1)(yH)|M.v0pq)fn//(i5q»^ 



Equation 8 



where the'repre^ertla^e points are: 
{!,J).{lwO&nd(kp,}4q). 



u(x, y) » «u3-ua)(x4)q+(uZ-u0){H»><H40pq>nfl/y(pqig 
v(x. y) - ((v3-v2)(x-l)q+{v2-vO)(y-j)p*vOpq)m//(pq>g 



Equation $ 



where the representafive points are; 
« (i,a,0,f^q)andj()4|)j4<j), 
or 



u(x, y) !>» {(u2-u3)(t+p-x)q+(ulHi3){|+q-y»>Hi3pq)rrV/(pc^<) 
v(x. y) - ((v2-v3}(l4'P-x}q'Kv1«v3)(|>K|-y)p^^r3pq)ni//^K) 



Bqua^on 10 



where the representative points are: {^-tpy Di HQ) (l'H'> i*^- 

maicng ft po^s,^^ to decrease tfie amount of pfoceasing by using p»<^,k and m which are numbers of 2^ (where n is a 
positive integer). 

Whan.the bilinear jnterpolatjon and^or extrapolation are used, letUng (uO. vO). (u1. v1)» (ufi. vS) and (a3. v3) be the 
coordinates deternined Ijy multipiying the horizontal and vortical ooni|ponent& of the motion vectors of the representa- 
tive points a J), (i+fx i). ft. j+<l) and (hp» i+q) kv K u(x. y) and v(x, y) are represented by the fdlowing equation: 



u(x, y) » ((i4q-yM(tH>-x)uO+(x-i)u1) +(y-i)((i+p-x)u2+(x-i)u3))m//(pciK) 
v(x y) «'{a'K|-y)(Ci+p-x>v04<x-l)v1) +(y-j)((i+p-x)v24<x-Qv3))m//(pqk) 



Equation 1 1 



Equation 11 can tw rewritten as: 



u(x, y) ((2L+1)«{a+p+h0'h1-1>+(i4<i-y)((i+phX)u0 
^(x-4)u1Hy-|)((kp-}0ul^(X'i)u3)) »(a4p^-h1)-L 



Equetion12 
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v(x. y) = ((2M+1)«(rt+^+W>-h1-1)'^G+<^-yX(«+P''*)vO 
+(x-0v1 )+(y-j)((i'*P-x)v2t<x-i)v3)) (a+p+hq -h 1 )-M 

6 by u&fng p. k and m which are numbers of 2^ 2^. 2^^, and 2^^ reapdcttvdy* nnaking it poeeibie to decreaee Ihe 
amount of processing as in the above^menltondd prooeseln^. 

(n order to obtain ^0 sanie predicted image of gjob&l motion compensation on the feranennitting side and on ttie 
receiving side, the data related to ^e motion vectors of the representative points muet be transmitted in a certain form 
to the receiving side. The motion vectors of the representative points may be directty trafsmitted. It 16. howwer* also 

10 possible to transmit the motion vectore of the corner pointB of the image and to calculate the motion vectors of the rep- 
resentative points therefr^nr ITtis metliod WtS now be describe 

Fif«t a case where the linear interpolation and/br extrapdiatnn cs enjoyed vi^ll be described, ft is assumed that the 
motion vectors of three corner points {Q, 0). (r, 0) and (0< a) of the imaoe take only those va^ wNch are irkeuKA mut- 
tiples of t/n. ar>d that the ooordlriates (uOO. vOO). (uOi , v01) and (u02< v02) wNch are detentnned by mt^dHplying the hor- 

iB izomai and vertical oompononfas by n ara tranenrdtted, In iMs ease, me coordinates (uO» vO), (u1 , v1), <U2« v2) and (u3» 
v3) which are determined by moitij^rtg tfio horizontal and vertical componema of ttta motion veciDre by K are defined 
asfdlowe: . 

so 

v0*vUi) 

ttS Vl ar V'(l+P. j) 

u2<iu'0»j'K0 
v2 - "/(i, j+q) 

^ where u'<x, y) and v*{x. y) are defied by the foOowdno ectuation, which is a modification of Equation 5: 

u*{x, y) « {(uOl-uOO)xe4>(LiO2-i;«00)yr^uOOre)l<///(ir8n) Sc^ticff) 14 

VXx. y> * (<vO1>vO0}xs4(vO2-v00}yr-i-vOOra)k/^(r^^ 

Here« "/IT r epve^^entedh/islon for roirndtofl the quotient of an ordinary dhrision into an adjacent integer when the quotient 
is not- an ir^egen and its pdority as an operator ia the same as that ol muttiplicatioft and division. Three points era 
selected out of vO). {u1. vi}» (u2. v2) and (u3, v9), and the global motion contpensalion to exeouted usirtg such 
. pomte ^ repteeeniaiiva points. Then, the global motion compensation can be epprcodmatad by using (o. o)< (r, o) and 

49 (0, s) ae ihe repreeentative points. Herat «?y we* hg p and q wWeh are 2^^ (n Is poi^tlva integer), the processing can be 
simplified ae descrSded earlier. In order to decrease the oparatkm eirore. it ie desirabie that 7/r rounds a value which Is 
not an integer into the most adjacent integer. In this oaeob methode for roumling a value of the Mn of an Integer and 
1/2 include the above-merrtltfied methods (i) to (4). Cmpared to the caea teing {Equation 9 (calculation for each pixel), 
however, the operation of Equation 14 (only three calculations for One image) doea not require many calctdation& Even 

w H methoda (I) or (2) are eelected. therefore, the total amount of Calculation is hoi ^eaUy affected. 

Whan three points different from those of the case using ^iiuation 13 are aeladad aa comer points of the image, 
the same prooassing can be realised by mocfiiying Etiuatlona a to 10. in addition to the above^entioned axamptasn isy 
lettir^ (u03. v03) be the coordinates determined by multiisiying the horizontal and vertical componarrte of a modon vec' 
tor at a corner point (r. a) ol the Imagd by n. Equatioh 1 4 can be rewritten as: 

es 

U'(x. y) » ((u01'UOO)xa<i'(u03-u01)yr-»uOar8)K///(rsn> Equation 15 

v*<x« y> n {{V0l-v00)x6<f(v0d-v01)yr+v00ra)k^//(r6n) 
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when (uOO. vOO). (uQl . vOi) and (u03. vi>3) ett^ If ansmittdd; can be rewrittert as; 

u*(x. y) » ((ii03ni0e)xsf (u02^CX))yr4iK>ors)k///(r5n) Ecfuaiton 16 

s v*(x, y) ■ ((v03'V02)x&4-(vO2-vQQ}yr'ivO0rB)k///|rBn) 

wvhdf) (uQO, vOO), (U02, v02) and (003, V03) ar d iravY&mltted: and can be rewrinen as: 

u'<x, y) a ({u02-u03)(r-x)©t(uOl -u03}{«-y)r-KiO3r«)k //y(r$n) Equation 1 7 

TO 

v'(x. y) « ((vO2-v03)(r-x)&f(vO1-vO3)(&-y)r^3fS}k ///(rsn) 

Mhon (uOI. vOI). (u02, v02) and (u03. v03) are br«i«fnHtod. 

The aama aN^ hoids avdrt whan iha l^inaar Intarpolatioii andtor axfrapolation are exaouled As in the above men- 

IB tiOfMd casa, aaauma that ihd nation vactom of the four corner repreaentaiive points (0. 0). (r. 0), (0» a) and (r, a) of the 
Image take only thoaa values which are Integral multiples of 1/n. and that (uOO. vOO}. (uOI. vOI). (u02. vOZ) and (u03. 
v03) which are n timee the horliontaf and varticai componenta of the representative points are trandn^tted. In this caee, 
(uO, vO), (u1 , v1). v2) and (u3« v3) which are k timas the fiorixontal and vertical conrponentd Of the motion.v^tDre 
of the representative pofnts (I. J). ihP, J), {1, Kq) and {Hp, J4q) are given i^y 8quat!on 13 as described above: Here; how- 

SQ ever, by modifying Equation 1 1 , 
utx y) and vXx. y) are defined by^ 

u*(x. y) » ({s-y)((rvx)iiO(Hjai01)*Hy((r-x}uO24^xuO3))k/y/(ren) Equation 18 

ss v'(JC y) « ((8-y)((r-x)vOO+xv01 Ky((r-x3v02+w03)}K ///(tan) 

The advantage of ^ .method in M^ifch the motion vadoie of corner points of the image are transmitted aiKl are 
fnlerpblated and^br extrapoleted to find motion vectors of representative points, is that fiie ranges of the nwfion vector 
lor each of the pixeia can be easily Med. For example, en the caee of the.billnear Interpolation btyUot extrapolation 

30 gi^ by '€qiiait6h 4. the value u^x. y) I& not greater tf)an the ma^^rium «atue of ua, ub, uc and ud and not smaller than 
the minimum value thereof when the point (x, y) is inside the image. Therefore, if a fimifSng condition ie added so that 
the values ue, ub^ uc and ud tie within a iimiied range (e.g., range within id2 pixels) at the dme of estimating the global 
motion, the value ug(x. y) can ise confined wHhin the same range for an pixels <1his also holds even for vg(x, y). as a 
matter of ^cbui^e). This makss it possKito to defliHefy determine 9m number of <fieits necessary tor the calototion, 

35 which is convenient from the etandjpoirtt of deeigntng eoHware or hardwaro. 

The .foregoing descr^^tKin. howew, is based upon the caee that the calcinations are all carried out based 
using floating-point arithmotio operations and« hence, care must be given In pracllce. The arithmetic operation (Equa- 
tion 18) for finding the motion veetom of representativa poirrts from the motion vectors of corner points of the image 
Involves rounding a value imo an integer. Therefore, consideration must be tafcsn to the probability ^t the motion veo- 

40 tors found by. Equation 12 may deviate out of the abot^e-mentioned itmited range due to the calcuiatipn eaor. In partlo- 
care must be taken when the representative points are located bislde the intage. TNs is because, the motion 
ysetors are fpundby the extrapolation for the pixels outside a rectangledeflned by representative points and, hence» the 
roimdirig erjfor may be.annplifled. 

Fig* 7 illustrates an example In which the motion vectors are fourtd by extrapdatton. When the glot>al motion oom- 

4s peneatlon is executed iof ths image 70 1 by using representative points 702, 703, 704 and 70S» the motion vectors are 
calculated by the extrapolation for the hatched portions inside the image. This Is because, the hatched portions exist 
outside a rectangle 70G defined tsy the representative points. 

This problem can be etfectiv^y solved by so arran^ng the tour representa^e pdnte that a rectangie defined by the 
rspresentajtive points fncludee the v^le image. This is shown in Rg. a A rectangis 806 defined by representative 

«> points e02, 803. 304 and 605 incftjdes an image 30 1 - Then the motion vectors of aH pixels can be found by the Irrterpo- 
iation from the representative points, and the effect of the rounding error at the representative pcrints Is not amplified 
insUe the Imaga Acconriingiy; an error larger than the rounding error at ropreeentatlve points never occurs inside the 
lmag^»and the upper limit of enor Is definite. When the rectanoie defined by the representa^ve points is too large, how* 
ever, the rdnge of values that the motion vectors of representative points take is so wide that a ru^nber of digits neces- 

S8 sary for the anthmstic opeiation increases, causing a d^isadyantag^^^ tram the standpoint of mounting. 

Prom the foregoing description, K Is desirable thai tTii pi ^s ^^er than r and the value q is larger than s in order 
to decrease the effect of the roundnig error. It H al8o;d^^oltii^lU> ^nd q assume values that are as large as possible 
even w^ien tfiay are smaller flwn r and a. It is turthei^ii*e«ilfa!?ife i and j are such that a portion which is as 

wide as possSale Inside the image is bi an area that i^ dt^ed^^the-^^ points. 

:■■ rVr'.^T; i'W.v -• •. 
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When the bifb'iear interpotation ofKVof oxtrapolabon are used for the global motion confipen6aii<»i as described 
above, the compwients of fTwtlon vectors pixels In the rdctangla defined by tho ftwo representative points can take 
only valuee that lie between maximum values end minimum v&lues of the components of the motion vectors of Uie rep- 
resentative points. When linear interpolation and/or extrapotation ts used, on the other Karrf, the m<^ion vectors of pix- 

0 ele in a trien^le defined by three representative points have the game properly. When the global motion compensation 
1$ executed by using the tinear interpolation and/or edrapolation. therefore, it is effective to transmit the motion vectors 
of the four corner poime of the imaflie and to cany out the global nx>tion compeneation independently for the tMo rlghl 
tfiangtes divided by a diagona} of the image. Then, the Irmita^ on the range of ^6 motion vectom of the four corner 
points can be directly applied to the motion vectors off aH pwele insido tho image. In thre case> the values r» j. p and c| 

TO may not be the eame betwe«i n>e two fight triangles, from the standpoint of operation errw» f urthemiore. it is desirable 
that triangles defined by the repreeentativa points include right trlang^ of which the global motion compensation is to 
l>e executed. reS|3ective^. in order to ovoid the calculation ot motion vectors of pixels by the extrapoiafion. This is shown 
in Fig. 9. The motion veciom ol points dOd, 903. dOS and 91 0 which are the four corners of an image 901 are transmit- 
ted, and the global motion compensation is Indepertdently executed for each of a right triangle defined by the p<^ts 

tB 909> 903 and 910 mi a right triangia defined by the points 909. 910 ^tvi 908, Theretore, if a limitation is in^xsed on 
the range of motion vectors ot vertaxes. the motion vectors of all pixels within the image are included in this limited 
range. The right triangle defined by the points 809, 903 and 91 0 uses points 902, 903 and 904 as representative pointa, 
and me right triangle defined by the p«nts 909. 910 and 908 uses points 906, 907 and 908 as representative points. 
The triangles defined by the representative points Inctude therein right triangles to which the global nrtotion oompensa- 

20 tton is to be executed, respectively Therefore, the effect of the rounding error of the motion vectors of representative 
points is not ampltfied at points inside the image. bi this exanipier the two triangles def Nied by the representative points 
are similar to each other. However, the triangles may not necessarily be similar to each other. 

The present trwention mahee it pos^e to subsfitute the shift operation for the divi^ for synthesizing a predictied 
image of global nnotion compensation, and to simplify the processing using other software or dedicated hardware or a 

£S contiinationof txiih. 

Fig. 10 shows me steps fbilGwed in peilbrming video coding of video image data uaing fast global motion compen* 
sation aooofding tO an ^fribodimeni the present invenftion. In step 150. a video signal is input and in Step 1 51 , giobaf 
motbn esUmatlon is performed between an lr^»it image and the decoded image of a previous f^ame. Then, the motion 
vectors are derived from the representative points of the input image in step 1 52. 
^30 In the next st^ step 1 53^ a predloted image of global motion compensation is syr^eeteed using the feel algorithm. 
The fast algorittim is a general socpreasion tor algorithms disclosed herein, such as vn bilinear alfloiithm and affine 
algorithm. For example, equation 1 ts an of^ine algorithm whereas equatk>n 2 is a bifinear ^gorithm. Further, equations 
3, 5, a 7-10, and 1 4-1 7 are affine whereas equations 4. 1 1 and 1 8 are bilinear 

in step 154, the local motion estimation Is performed between the tnput image and \he decoded image of the pre* 
^ vious frame. The predicted image of local motion compensation Is syirtheSized in step 155 and ^ global or local 
ntotion coinponsatlon for each block la selected In step 158- The selection step is necessary since the gktosA nwtion 
compeneaton and local motion compensation steps are performed in parallel in this embodiment. 

Then, in step 157. the error Image is synthesized by calcJating the difference between the predicted image and 
the rnput Image and the error image is subject to a discrete cosine translbrm for quantizing the OCT coefficientB in step 
49 1 58. really, in step 1 59. the compressed video data is output- 

In Fig. 1 1 , an alternative embodiment is disclosed lor per^ming video coding, which is similar to the video coding 
dis<toed in Pig. 10. Specifically, ^teps 150-1€3 ere tiie same, but the renvainder of the steps shown In the flow chart 
are different The reason for this Is that the steps perfwrmed In f^g. 1 1 are for perfonwng tfie locaJ najtion compensation 
end global motion compensation seriatty, rather than in parallel as in Fig. 1 0. Accordingly, in &tep 254, local motion esti- 
4$ nfmtbn is performed between the vt^yiA image and the predicted image of globat motion compensat{(»i. Then, in step 
255. the predicted image of local motion conpensation is synthesized- Finally, the error image is synthesized by calcu- 
lating the difference t^iween the predicted image and the input image. Just as m step 157 in 10, and steps 257 and 
258 ere the same as steps 158 and 159. e9ipldir\ed above> 

Fig. 12 shows a flow chart of the video decoding according to the present invent. In step 160. an Irput bit stream. 
$0 such as a h.261 bit stream is reoerved as the comprossed video da<a> The nxition vectors of the rspresentaffve points 
are derived and In step 161 and in step 162, the predcted image for blocks which selected globaf motion conpensatlon 
using the fast afgorithm are selected. In step 164. the predcted image for blocks which selected local motion compen^ 
sation are e>^e8jzed. The error image vwth respect to the predicted image is synthesized In 165 and the enror 
image Is added to the prediaed Image in 168. in step 167« the reconstructed video signal is output to complete the 
^ deooG^ng of tfw encoded video data- 

Aooording to the embodiment of Rg. 12, the synthesizir^ of the predicted image for blocits which BSloctod global 
motion compensation usaig the fast algorithm ar>d also for blocks whk;h sheeted local motion compeneation Is per- 
formed in parallel. On the other hand, in Fig. 1 3. the f kMr chart shows an alternative entediment in which these steps 
are perfbrmed serially. 
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In 13. steps 160 and 161 are the same those in Flg^ 12. in step 262. the predictod innage of global motion 
compensation using tho fact aigonthm is synthesized and in step 263 the predicted image of local motion oonpeneatEon 
16 Gynthestsed. These stope are performod serially and foSowed by Iho et^ of synthesizing the error imago apph^ing 
invoree OCT to the OCT ooefficierkts. which Is the same as etep 165 in Fig, 1 2, Stepe 265 and 266 which fotiouv are afeo 
tt ^ same ae stepe 169 and 167 difioissed with reepect to Fig. 12, and which result in the output of the reconstructed 
video signal. 

Figs. 14 and 13 are block diagrams of the oornponents of the encoder and decoder of the invertdon for etoilng and 
executing softwvare operating as dfsdosed in the flowcharts of Figs. 10 -13. The cofYpor)ents in oommon for both c6a- 
grams have the same refensnce numbers and include the cteta bus 140. CPU 142 and storage donee 143. The encoder 

1Q prof^amlbr executing the vid€K>Oitioding is sfiown in Fi^^ 14, and isstoredlnstoragedo^ice 143. the decoder program 
for 6](eouting tiie video decoc^ is shown m Fig. 1 5^ and i$ stored in storage device 1 43. Storage dei^s 1 43 are ^r- 
age media, such as hard dtslc drives, floppy disks <v optical disl<s. for exannpl& 

With reference to Fig. 14. an Irijmt video signal la A/D converted by A/D converter 141 and sent to CPU 142 over 
bus 140. CPU 142 retrieves and executes the encoder program 144 stored in storage device 143 end then encodes and 

IB confesses the video data received from the A/D converter 1 41 . After the video data is encoded, it is stored In an out- 
put buder 146 and output as output data. Control data and timing signals are also output with the compressed video 
data. 

Fig. 1 5 shoMvs the processing of coded video Siijnal, which 19 received at input buffer I4fi and then read by CPU 
142. CPU 142, wl^ch retrieves tiie decoder program 147 from the etomge device l4d« executes the decoding of the 
20 coded vtdeo data. The deooded video data is thsn sem Over bus 140 to D/A converter 1 46 tor outputting an anaioo 
video signal. 

Fig. Id shows the overall blocic diagram of a video coder acccrding to the invention that Is simiiar to Fig. 1 of the 
prior art. Accordingly, the cornponents in oommon for both diagrams have tfte same raf^ence numt>ersL in tiie digram 
of F!g. 16, btocfc 116 Of Fig. i» which is a block matching unit tor local motion compensation, is r^aced with a block 

28 1002 that uses gktel motton compensation and local motion con^ensa^. Ofhenwise. the remaining components in 
the Fig. 1 6 diagram are the same as thode In tha diagram of Fig. 1 . 

in Fig. 17, a motion estimation and compensation unit 1003 that performs serial processing is shown. Unit 1003 
cart be used as the motion estimation and compensation unit 1002 of Fig, 16. Further, unit 1003 is a hardware errtbod- 
tment pertorming functions nearly equivalent to the steps perfbrnned in the software processing shewn in Rg. 1 1 . 

so As shown In Fig> 17« an Input video signal 101 is received 1^ the global itioiion estimation unit 1004 and also by the 
block matching unit 405. Global motion estimation is perforrhed iMlween an input Image and the decoded image of a 
previous lianrie by the globalniiolioneBtimatioR unit 1^ 1004 also derives the motion vectors from the represent- 
ative pdnts Of the input Image. The data 403 related to these vid ues is transmitted to the global motion oompensatk>n 
(OIMG) image synthesizer 1005 which ^rttheslres the predided Inmge of ttie globa) motion condensation using mo 

ss fbflt algorithm. A predided image 404 of global motion corrponsaHon is ^len output to Mock matching unit 406 in which 
iooal motion estimation between me ir^Tut image and the predicted image of gtobaJ moSon corvipeneation is pertormed. 
then, the molian vector data 406 is output to the muftiplexer 407 and the predicted images of the present frame 11 7 is 
output to the adder 102 fbr synthesizing the eaor (mage by calculating ttie diftra'ence between the predicted image and 
the Input image. The motion oonpensaiion unit shown in Fig. 17 uses serial global motion estimalran and local motion 

40 eatlmation. 

In F^i. 18. a motion condensation unit 1008 which can be used as me motion compensation unit 1002 in Fig. 16 
is disclosed in wtiich parallel processing is performed tor the global motion estimation \Mt and the local motion estima^ 
tion, as fbilows. First, a video signal 101 Input and received by both global motion estimation unit 1006 and block 
matching unit 606. Then, global motion estimaton ia performed between the Input Image and the decoded image of (ho 

48 previous frame by the global rnotion estimatk>n unit lOOd. Th« motion parameters 504, such as the motion vectors of 
representative points are irput to the mul^exsr 510 and the ^bal motion compensation (OMC) image synthesizer 
1007. A predicted image of gtoba) motion compensation using fact algorithm is synthesized and output to a block 
matching/gtoi>ai motion oont>ensation changeover switch 606 for outputting the |:?edioted iftiagd of the presem frame 
117. cbtsined by one of global or local motkm compensation for each ttock. The selection data 609 of the changeover 

so switch selection Is output to the multiplexer 51 0. The mult^^exer also receives the output of 507 of Nock matchur^g unit 
50i5. which is ihe motion vector data. A signal 120 is output from the mutiplexer that includes signals 504, 507 ortd 509. 

Fig. 19 shows a btock diagram of a video decoder that is similar to the prior art decoder of Fig. 2, but that incHides 
the addition of a predicted image synthesizer lOiO which synthesizes the predicted image in accordance with an 
embodiment of the present tnvenson. Otherwise, the remaining componerrts of the decoder 1009 are tfie same as 

56 shown in Fig. 2. 

In Fig. 20, a predicted image synthesiser according to one embodiment of the Invention 101 1 is shown, which can 
be used tor the predicted image symheslzer 1010 shown in Fig. 1 9. Serial processing is shown in F\q. 20, in wNch the 
motion vector data 202 is received by the mUitiplexer 1013, whk;h provktes the motion parameters 403 and motton vec- 
tor data 406 to the global motion compensation (QMC) image syrithesizer 1005 and the btock matching image synkhe- 
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eizor 1012. respectively. The GMC imfi^e symhesizef 1005 derives the motion vectors of representatives points and 
syrrihesizes d predicted image ot global nrwdon compensatkm using the faet algorithm. Then, It otitputs the predicted 
image of glotsai motjon con^ientiation 4€4 to the BM Ermge eyntheehser 1012. whic^ eynthestzes the predfetod image 
of locfil motion compensation. The predicted Image 61 the present firame 2ia 16 then output to the swildilng unit 214, 
s aa ehown in Fig. ig. 

Fig. 21 fihowa a precfieted Image ayniheateer 1014, whfch operatea to proceaa the global moBon compensation 
image $ynthesizHig and iskiGk matdiNng triage eymhesizing in parallel, as lioiiowe. 

The motion vector data 202 fa input to the multiplexer 1016, which provides eeperated motion parameter data 504, 
moCk>n vector data 507 and seiedion data of »ock metchfaig/global motion compenaation 509 to the OMC image syn- 
10 theelzer 1007. BM image synthesizer 1015 end SHvitch 608, respectively, ad shown. The BM Mtiage aynlhesixer 1015 
syntheeixea the preeScted Image Idr tslooKs which selected the local motion compens^ion and the OMC image eynitie- 
sizer 1007 eyntheeizee the predicted image for blocks which selected the global motion compensation using the fast 
atgodtim The respective data 503 and 506 is output to ^ ewttch 50Q, which selects one of these signala aoooiding to 
the selecfon data 509, received from the demultiplexer. The predicted image ot a present frame 2i 2 ie then output and 
IS received by switching unit 214. as shown in Fig, 19. 

Acoorc^ng to the embodiments of the invention, the video codaig and decoding can be performed either by sofliwe 
operating as shmn in the flowcharts of f=igs 10^13 using the software encoder or eoftware decoder shcM in Figs. 14 
and 15 or b>y dedfcated twrdware. as shown in the entxxfimsnts of the invention in Figs. 16-21 . 

so Ciainis 

1. A mettiod of gKtfMri motion compensatioa comprieing: 

calculating the motiOR vectors for all pixels tn an image by etfecfing linear interpolation andA>r extrapolation of 
S5 the motion vactors at three or four representative points for the famge. and 

assuming eanrqating intend of the pixels to be 1 in iMlh horizontal arxS vertical directions with respect to the 
ifY^age. and assuming sannpl^g points for which horii^ontal and vertical components of coordinates of the sanv- 
piing potoTte are both integers, 

wherein the representative points are three or four of the points havir^ the coordinates (i. J), (i^p, j), (i. h<0, and 
so ri4p. J4q). (where I and J an» Integers, and p a^ q are positive intagers)» and wherein p and q are Sl<' and 2^ (a 

. and ^ are positive imegere). respectively. 

2. A rnethod of ^nlheslsfclng an intert^e predicted 

• * ■ ' , . 

SB sampling an image with sampling intervals of pixeis in an image of 1 in both the f)orizontai and ver^l direc- 

tion ond .wHh sstfnplbig polrrts having horizontal v>!di vertical cocnponents of the coordinates ttial ars both inte* 
gers; 

wherein M horlzomd and vertical components of motion vectors at r^esentatlve points (i. D» D and 0. 
j4q) assume vakies of integral multlpleB of 1/k or^ (where i and j are integers, p and q are positive integers. ^ 
40 is 2^ and hO Is an Integer which is not negative). 

yvt»en tt>e hoiizonial and vertics) components of the motion vectors of the pixels assurne vaiuee of integral mul- 
tiptos oii 1/m only (where m is 2''\ and hi is an integer which is not nega:6ve). 

using (uO. vO). (u1. vi) and <uS. v2) (where (uO, vO. ui. vl. u2 and v2 are integers) which are k times (he hor- 
. . izontat arvl vertical components of mofon vectors at the representative points (i. j). (i-f p. D and (i, j'Kt). 
49 wherein (u(x, y) and v(x» y)) which are m times the horl%oniat and vertical components of the mofion vector of 

a plxe4 (X, y) (where y, u(x, y) and v(x, y) are integers) are cpven by 

uiK y) s (uO • p • q+<ui4iO)(X'i) ♦ Qf(u2'U0)(yi) *p)m//(p •q • k) 

« . v(x, y> - (vO • p • q+(vt -vO)(x-i) ' q4(v2-v0)(y-i) • p)m//(p - q • k) 

(where "/f represents a division ibr rounding the quotiem of the ordinary division into an aCf^cent Integer when 
the quotient of the oidinary division is not an integer, and lis prtority as an operator is the saitie as that of the 
ordinary muttipiiea^ and division) and 
88 wherein p and q are 2" aiKt tlfi {wh«re o and ^ are positive integers), re$pectively. 

3. A metfiod of synthesizing an irrfeerframe predicted image, comprising: 

sampling an Image with sampling intervals pixds tn an irrsige of 1 in Isoth the horijsonial and vertk:al dfrec' 
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ticm and wHh sampling points havkig horizontal and v«nical conponerHs ol tKe coorc^nafas that are both im&- 
garfi. 

wherein horizontal and vertical components of motion vectors at r^esentative poims (1. ]). (i^p. j) and fi+P. 
|4«() assume values of Integral nBjfliplee of 1/k only (where i and J are inlegera. p and q are positive Integers, k 
ie 2^^. and hO is an irrieaar which is not negative). 

when the horiiEontal and vertical oomponerrts of the motion vectors of the pixels assume vitfues of Integml mul- 
tiples of 1/ni only (where m is and hi is an integer wtuch is not negative), 

using (uO, vO). (ui . v1) arKi (u3. v3) (where uO, vO. ui » vi » ud and v3 are Integers) which are k times the hori- 
wtaH and verticai componenia of the motion vectors at ihe representative points (i. D. j) ^ O-h). 

10 wherw n (u(x» y) and v(x, y)) which are m times the horizonUit and vertical components of the moGcn vector or 

a pixel (x, y) (where x. y« u(x, y) and v(x, y) are integers) are ipven by 

U(x* y) » (uO * p * q+(u1-u0)(x-i) • Q+(u3-ut)(y4} ' p)nV/(p - q * k) 
19 v(x. y) - (vO • p • q+(v1 -vOXx-0 • q+(v3-v1 K/'j) • P) "^tZ/CP • <l • H) 

(where 7/' represents a division for rounding the quotient of the ordinary divtsion into an aicf acent iniegar when 
the quotient of the ordinary c^sion is not an integer, and its priorOy as an operator is the same as that ol the 
oidimury mu}£pteatk)n and dMsion) and 
so wherein p and q are 2" and 2^ (wh^ a and p are positive irdegers). respectively. 

4. A method of synthesizing an interfiame predicted Image, con^^riang: 

sampling an image with sanpling intervals of pixels in an image of i in both the horixontai Sthd verticaJ direc- 
£S tkma and with samptk^g points having horizontal and vertkml cornpcnents of the coordi n ates that are both inte- 

gen», 

wher^ the horlzontat and verticai corrponents of motion vectors at representative points (i, j), ([, i^ and (i^p, 
fKj} assume values of integral mtdtlples of 1/k only (where t and J are integers, p and q are posiliveintegens;. k 
is 2^ and hO ie an integer which is not'negallve), 
so when the horfzontaf and verltoal conponente of the motion vectors of the pixels assume vitfues of integml mui- 

«ples of 1/m oi^y (wh^e m is S!**^, arid hi is an integer which is not nega^h 

using (uo, vO). (u2. v2) and (ud. v3) (where uO. v0.u2.v2.u3 and v3 are integers) wMch are k times the horf- 
xontal and vensoal components of the motfon veotcrs at ^ ropresentalive points (i, J). (i. fK|) and (^p, i^q), 
whereni (u(x, y) and v(x, y}) which are m times the horizontal and vertical components off the motion vector of 
9$ 8 pixel (x, y) (where x, y» u(x. y) and v(x, y) are integers) are given by 

Li(x» y) • (uO * p * €t^\iQ^){V'^i • q4-(uS^}(yi) * p)m//fp * q * 1^ 

v(x, y) « (vO * p « q+(v3-v2)(x4) * q-^vS-vOKyi) * p)m//{p * q * k) 

40 

(wtiere V/* represents a division for founding the quoHm of the ordinary division into en adiacent Integer when 
the quotient ol the ordinary division is not an integer, and its priority as an operator is the same as that of the 
ordinary mu^Ucatton and division) and 

wherein p and q are 2^ and 2^ (where a and 9 are po^tive integers), respectively. 

45 

5. A method of i^nthesizing an interframe predicted image, cornprlsing: 

sampling an image with sampling intervals of pixels in an Image of 1 in both the horizontal and vertk:al da^ec* 
tlons and wHh sampling points having horizontal and vertk:al conrponents of the coordinates tet are iMfh Ne- 
80 gers. 

wherein the horizontal and vertloal components of mo^on vectors at represematlve points (kp. i)< G. I-kO and 
(i+p. j-Ki) assume values of inte^-ai values ^/k ody (where t and j are integera p and q are positive integers, 
k is if^, and hO Is an integer wMoh is not negative), 

when the horizontal and vertical conponents of the motbn vectors of the pixels assume values of bfitegmt mul- 
ss tlples of 1/m only (where m is 2^^ . and hl is an integer which is not negative)* 

using (u1. v1). (u2. v2} and (u3. vd) (where ui, vi. u2. v2, u3 and v3 are integers) wNch are k tintes the hori- 
zontal and vertical comporierits of the motion vectors at representative points {np, j). (1. Hq) and (i-h'. H<0. 
wherein (u(x. y) and v(x, y)) wNch are m times the horizontal and verticai components of the motion vector of 
a pixel (x, y) (where x, y. uOCi y) dnd v(x, y) are integers) are giv^ by. 
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U(X. y) * (u3 * p • q+(u2-u3)(p-x-H) - q+(ul ^u3)(q'y4j) • p)m//(p • q ' k) 

v(x, y) e (yO • p • <H^v2«v3)(p"**-i) • q+(v1-v3)(<|-y+j} • p)m//(p • q ■ k) 

5 (where Vr r^resents a cti vteion ftx rouncSng the quotient ot the prdinsiry division into an ndjaoent integer when 

the quotient oi fhe ondinary civ48ton i$ not en integer, end k& priority as an operator ia the same as tfiet of the 
cffdrnary muHiplicatian and drvf^ton) and 

wherein p and q ere 2** and 2^ (where a and p are positive integers)* respeccivety. 

10 6. A method of syntheelzing an Interfraine predicted imaoe» oomprising; 

sampling an snage with sampiing intervals of pixete In an image of 1 in K>oth the horizontal and vertical din^c- 
tone and witfi eampf^g pointe having horizontal and vertical components ol the coon:linatee that are i:>oth inte- 
gers, 

wherein the hortzomal end vertical componenia of motion vectora at reprasenrtatlve points {I j). (i+p. ]). (i. J4q> 
and (kp» jtcO assume values of integral values of 1/k only (where i and j are integers, p and q are positive inte- 
gers, k rs and hO is an tntegsf whtch is not nagative)^ 

when the honzonlai and vertical conponents of the motion vectors of the pi3<els assume values of integral muf- 
tipies of 1/m oniy (where m is 2*^\ and hi is an integer whidi is not negative), 

using (uO, vO). (ut, v1). (u2. v2) and (tJ3, vd) (where uO, vO, ut> vi^ u2, v2, u3 and v3 are integers) wtiich are 
k times ss sF^t as the hoH^Eomai and vertical oomponems of the motion vectors at repreaeniative points (K j), 
0+P. i>. (I. Hq) and (l+p. j-Kj), 

wherein (u(x, y) and v(x, y)) which are m times tfte horixontal and verScal conponente of the motion vector of 
e pix^ (x. y) (whtf e x, y, u(x, y) and v(x« y) ere integers) are given by, 

o(x, y) B ((uO(p-x+i>u1 (xfl)(q-y*i)+ (u2{p-x-H>HJ3(x-i))(y-D}nV/te • q • k) 

v<x, y) - ((yO(p-x-«4-^1(x-i}Xci-y^)-*- (v2{p-x+i)^v3(x-i)){y-j))nV/<p ♦ q • k) 

SO (where "ft r^esents a dtviston for rounding the quotient of the ordinary divlston into an accent integer when 

the quotient of ^s ordinary division is not an integer, and its |xk>rj1y as an operator is the same as ttiat ot the 
ordinary multiplication and division) end 

wherein p and q are 2^ and 2^ (where a and p are positive integers), respective. 

9tf 7. A metfiod of symhesialing an inf etfreme predicted image aocorcing to ary of claims 2 to 5, wherein 

the coordinates of pixels at the left upper end, right upper m^. left tower end ^ right lower end of the image 
are (0. 0). (r, 0), (0, s) and (r. s) (where r and a are positive Integens). 

the horizontal and vert^l components of motion vectors at corrter points (0. 0), (r. 0) and (0. s> of the image 
tske vaiuee of integral mtitlples of lAi (where n is a positive imeger), 

said method uses (uOO, vOO), (uOl, voi) and (uoe, v02} (where uOO, voo. uOl, vOI, u02 and v02 are integers) 
which are n times said motion vectors, and 

(uD. vO), (u1 , vl). (u2, v2) and (u3. v3) which are k times the horizontal and vertical components of nwtion vec- 
tors at points (i. j), (ki>. D. (i, and (i^ >k|) and are s^ven t)y, 

uX*. y) - (wOO • r » &KuOt-uOO)x * 8i-(u02-uOO)y * r)k /y/(r ♦ s ♦ n) 

v*{x. y) B (vOO • r • S4-(vOl-v00)x • St<v02'v00)y • r)K //y(r • s • n) 

60 iX) a u'{i, j) 

vO « v'(i, j) 

u1 - u\i^. j) 

Vl m v'O+p, i) 

UZ B uU J4q) 



IS 



SO 



40 



45 
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v2 « v'(j. 

u3 * u'Ci-f p. j+q) 

B v3 o v'(i4p, Hq) 

(where 7/r represents a dtvi^on for rounciing the quotient of the orcfirtary division into an adjaconi integer when 
the quotient of the <^ration is not an iitteQef. and its prkarity as an operator Is the same as that of the ordinary 
muhiplication and di^rleion) and 
10 further uvherein three points amor^ these four points and their motion vectors are used as represeotath^e 

pointe end their motion vectors^ respectively. 

A method Of eynthesizind an imerframe predlctGd image according to any of cKaim 2 to 5, wherein 

19 the cooifdJnates of pixelB at the left upper end, right upper end, left lower end and right lower end of the image 

are (Q. o), (r, 0). (0. e) and (r. s) (where r and s are positive Integere), 

the horteontel and ver tlcal components of motion vectors at corner points (0. 0). (r. 0) and (r. c) of the Image 
take values of integral mutinies of l/n (where nis a positive integer). 
' said method uee$ (uOO. vOO). {uOi . vOI) and (u03, v03) (where uOO« vOO. ii01« v01« u03 and v03 are integers) 
£0 which aro n times as great ac said niotk>n vectors, and 

(iio, vo). (til , VI), (u2. v2) and (u3. vO) which are k dmes as great as the horizontal and vertical components of 
motion vectors at potnts (i. ]}. C»«P. j)« Hi) and (kp» j4q) are given by, 

iTCx. y) « (uOO • r • s+(uOVuOO)x • e+(u03'U0i)y * r)k///{f • a • n) 

as 

v'(x, y) m (vOO • r * e4-(y01'v(X>)x * s<i'(v03-v01)y • r)k ///(r • e • n) 

UO • u'(i. D 

ac vO tt v'O, D 

Ul ^ U'(Hi>, j) 

vi a vO+p.!) 

35 

u2 «u'(i.tKt) 
v2ov'(ij4q) 

40 u3 s u'iUp, 

v3 a v'(i4p^ i4<|) 

(where 7/r represents a divraion tor raunding the quotient of the ortfinary division ^ an adjacent integer when 
46 the quotient of the opera^on is not an Integer, and its priority as an operator is the same «i$ that ol the ordinary 

mitftipiicafioh and Colston) and 

further wherein three points among these four points and their motion vectors used as representative 
points and their motion vectors, respectively. 

^ 9* A method of synthesizing en interfreme predicted image eccoiding to any of claim 2 to 5, wherein 

the coordinates d pix^ al the left upper end, right end. left lower end and nght lower end of the image 
are (0" 0), (r, 0). (0, 9) and (r, s) (where r and s are positivB integers), 

the horlzorftal and verticaJ components of motion vectors at oomw^ points (0, 0), (0, s) and (r, e) of the image 
6S take vaiu^ of Integral mtdiip)66 or 1/n (where n is a positive Integer)^ 

said method uses (t^, vOO). (u02. v02) and (u03. v03) (where uOO» vOO, u02. v02, u03 and v03 are Integers) 
which are n times as great as said motion vectors, end 

(uO. vO), (ul, vl). (u2, v2) and (u3, v3) which are k times as great as tiie horizontal and vertical conponents of 
motion vectons at points (I j), Chp. j). (i. i-Hi) and (i-tp. j^h)) are given by. 
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y) ^ (uOO • r • Mu03^uO2)x • e+(u02-uOO]y • r)k ///{r * s « n) 

^(x, y) " (vOO • 1 ' 6+(v03-v02)x • s^v02^0)y • r)k ///(r • $ - n) 

vOovUfl 
v1 « vTi+p. j) 

u3 » u'04Pb H<0 
v3 « V<l+p, 

(where 7//" repr^Berns a dlvisf on fbr rounding the quotient of the ordnary divlelon into en ad[iaeent imeoer when 
the quotient of the operation is not an 4nte^. and its priority as ah operator is the eanne as that of the or<flnary 
muhlpScatfon and di^48ion) and 

Kirther wherein three' point»^ among these tour points and their motion vectore are used ae representative 

ss pointe and thair motion vectors, reepecfivety. 

• .... • • . . 

■ * ■ . • • 

IOl :A method of eyntheelzing an interfmme predicted image aocordina to any of claims 2 to S» witerein 

coordinatee of pIxeiG at the left upper end. right Msper end, left lower end and right lower end of the intage are 
30 (0. 0)» jr. 0>* (0, 8) and (r. a) (where r and e are po^t|ve intogere).. 

Iha hbriiontal and vertical compohanta df motion vectore at comer p^nia (r, 0)» (0, a) and (r, a) of 9ie image 
take values of infect muliiplea of Vt\ (where n is a positive imeger). 

eakf method u^ee (uOl, vOl). v02) and (uQ3, v03} (where uOl, vOl. u02. vQ2, u(^ and v03 are integers) 
which are n times ae great ae said motion vectors^ and 
aff '■ (uD, vO), (u1 i v1). (02, and (u3{ v3) which are k timee as greet ae the horizDntal end vertical componema of 

' motion vectors at points (I* D. J). J-kO and (l+p, J<Kt) are given by; 

ti'(x, y) » (u03 • r * 8+(u01 *uOd){r*x) - ^ (u02-u03Ka-y) • * 3 ' 

40 v*(x. y) «■ {VQ3 • r ♦ s+{vOi -vOaXr-x) • s+ {sK)2-v03)(a-y) * r)k///(r * a * n> 

uO - u'(i. 0 

vO « v'(i. i) 

u1 - u(i*p, D 

vl*V(l+p.D 

60 U2 at U% i4<|) 

v2-V(i.H<0 

55 

v3 - V(l+p. J-HI) 

(M^ere 7/r represents a dlvie»on lor rounding the quotient of the ordnary divieion into an adjacent integer when 
tfie (quotient or the operatkTn ie not an integeri arid its priority as an opemior is the same as that of the ddinaiy 
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mult^icdtton and dh/ision) and 

further wherein three poirYtG among these four points and their motion vectors are used a& representative 
potnte and their motion vector^ respecttvety. 

s 1 1 . A method of ^yr^esizing an intoffreme pr«dtoted image acoordins to claim 6, wheren 

the ooofdinatee of pb^ets at the feft upper end. 

the coordhates of pixels at the left upper end, right u^r end. left lower end and right tower end of the image 
are {0, 0), (r, 0)» (0. a) and (r, &} (where r and & are poaitive inteQer^), 
10 the hortzontftf and vertical components of motion vectors at corner points (0. 0). 0). (0, a) and (r. a) of the 

image take values of integral multipl&s of 1/n (where n ie a posrtrve frrteger)» 

afiud method uses (uOO, vOO). (uOi. voi), (uos. vq3) and (ii03. v03) (where uOO. vOO, uOI, vOI, uoa, v02, u03 
and v03 are inte^er^) whiish are n times as great aa said motion vector&» and 

(uO. vO), (ui r vi). {u2. v2) and (u3. v3) which are K timee as great as the horiTor^tal and vertical oomponenta of 
IS wciion vectofs at repreaentatrve points (i. j)* CHfX D. 6, j-tq) and (H-p, \^ are given t>y, 

u'CXi y) - ((a-y)(uOO " (r-x>4it01 • y(u02 » (r-xKu03 « x}}H///(r * a ^ n) 

vXx» y) a ((a-yXvOO • (r-x}4<v01 * x)4> y(v02 * (roc}+v03 • x))WfJ{r • a • n) 

eo 

UO m M'O, j) 
VO«»V(l.j} 

Vl-V'(i4p.j) 

JO 

vZ»V(lj4q) 
u3 uXkp, 1^ 

35 V3 i" v*(i'»fi, j-kO 

(whera 7/r represents a division lOr rounding the quotiem of the ordinary dhrialOn into an adjacent integer when 
the quotient of tfte operation la not an integer, and Hs priority as an operator is the same as that of the ordnfnny 
muKiplioatloo and dMaion). 

40 

12. A mettiod of ayn^eaispig an imerframe predicted lnf\age according to dalm 1 . wherein the image is divided into two 
rl^t trlan^s^ea using a diagonal, arvt the global motion oompensatlon is ind^endentiy effadad for the F^ets con- 
tained herein based upon finear interpolation and/or extrapolation, wherein three representative points are used. 

4S 1 3, A method of synthaslzinQ an intffltrama predicted image accofding to any one of claims 2 to 11 , wherein 7r and/Of 
7/r are hirther defined to reprasont operation for rounding the quotient oi an ordinary division into the moat atiga- 
cent Integer. 

14. A method of syrthesfeing an tmeftrame predicted image according to any of claims 2 to 1 1 , wherein and/or V/r 
SQ are stiil further defined to represent an oporatioh which, whan the quotiem of an ordinary division is a value of the 

sum pt an Integer and rounds this value toward 0. 

1 5. A method of synthaslzing an interTranie predicted image according to any of claims 2 to 1 1 , wherein 7r and/or 7//" 
are still turner defined to repreGent an operation which, when the quotient of an ordinary division m a value of the 

ss sum of an Integer and rounds this value away Itam 0. 

16. A irieshod of synthesizing an Interframe predicted Image accordir^g to any of cl^nrts fi to 11 . wherein Vr is still fur- 
ther defined to represent an operatksn which, when the quotient of an ordinary division is a value of the sum of an 
integer and 1/8. rounds this value toward O when the dividend is negative and rounds tftis value away from 0 when 
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the dtvidend is positive. 

17. A method of synthe^zing an fnterfrome precficted imagft accordiitji to any of cleims 2 to 11 . wherein 7/" is etiH fur- 
th6r dfif in«d to r^reeem an operation wNch, when the quotient of an ordinsf y division » a value of the sum cf an 
5 inte^r and 1/2^ rounds this value away from o when the dividend Is negative and rounds this value toward 0 whan 
the dividend is positive. 

1ft. A method according to claim 1 , wherein when r denotes the lateral length of the Image and s denotes the varticat 
length of the imagei p smaller than r, 2p is larger than r. q is smaller than 6» and ^ larger than 8. 

w 

1$. A method aoooiding to claim l » wherein when r denotes the lateral length of the image and s derates the vertical 
length of the Image, p/2 is smaller than r. p is (anger than r, q/2 i^ smaller tan &» and q Is larger than s. 

20. A method 01 coding and decoding an image tiBSed upon the rriethod of daim 

IS 

21. A method of oocRng an image based upon the method of claim 1. wherein the data related to the motion vectors of 
the rapresentative points are directly ocded^ 

22. A method of decoding an image based upon the metfwd of daJm 1 , wherein the data related to the motion vectors 
20 of the representative pdms thai have been directly coded as coded data are used by reproducing me data. 

23. A method of coding an Image based i4>on the method of datm 1. wherein the data related to motion vedons of 
points at comers of an unage are cfireoliy coded. 

9s 24* A method of decoding an ^ge based upon the method of dalm i , wher«n the data related to motion vectors of 
points «t comers of an Image that have been directly coded as coded data, are used by reproducing the data, 

25. A storage medium for storing a global motion compensation program, the program compnslng: 

90 calculating the motion vectors for all pbcets In an image by effecting linear interpolation and/or eoctraiMlafion of 

the motion vectors at tt^-ee or four representative pomts for the image, and 

assuming sampling intervals of Uie pix^e to be 1 in both horizontal and vertical directions with respect to the 
image, and assuming sanpling pofftts tor wttich horizontal and vertical corhponente dt coordinates of the sanv 
piing points are both integers^ 

$s wherein tt>e representative points are three or four of the points having the coon:linate& (i» H (i^A j)< >k|). and 

(i+p. i+q) (where i and j are integers, and p and q are positive Integers}, and wherein p and q are 2*" and 2^ {ex 
and ^ are positive integers), respectivety. 
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